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PreJCace 

I  an  convinced  that  the  Air  Force  can  do  a  better  job  of  scheduling 
aircraft  subsystens  for  base-level  inspections.  The  discussions  I  had  on 
this  subject  with  personnel  at  Headquarters  Air  Force  Logistics  Command 
and  the  Air  Logistics  Centers  echoed  this  conclusion.  Furthermore,  the 
absence  of  any  complete,  systematic  method  of  setting  inspection 
intervals  for  base-level  inspections  confirmed  in  my  mind  the  need  for  a 
decision-making  aid  in  this  area. 

Vhat  I  intended  to  do  in  this  thesis  was  to  draw  attention  to  this 
deficiency  and  provide  a  strategy  for  correcting  it.  The  general  model  I 
developed  can  serve  as  a  starting  point  for  System  Program  Managers  and 

i 

their  staffs  who  are  charged  with  making  inspection  interval  decisions. 

It  is  designed  to  deal  with  the  subjective  factors  (e.g.  failure 
consequences,  probabilities,  opportunity  costs)  inherent  in  the  aircraft 
maint  .'nance  world.  The  decision  model  I  have  proposed  defines  how  these 
subjective  factors  affect  inspection  interval  choice.  I  think  this 
decision  analysis  approach  is  an  improvement  over  the  current  "that  looks 
about  right"  method.  I  hope  those  people  in  the  Air  Force  who  are 
responsible  for  making  inspection  interval  decisions  find  my  work  useful. 

Before  I  close,  I  want  to  thank  my  and  sontl||PI|^  for 

their  patience  and  personal  sacrifice  during  the  research:  it  was  a  team 
effort.  Also,  I  want  to  thank  the  Lord  above,  who  was  not  only  above  me, 
but  with  me  when  I  needed  additional  energy  and  creativity.  Finally,  I 
want  to  thank  my  faculty  advisor.  Captain  Joe  Tatman,  for  his  reasoning, 
availability,  and  technical  competence  which  motivated  me  and  helped  me 
draw  upon  my  own  potential  in  performing  this  research. 

Keriit  L.  Stearns  II 
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Abstrict 

Using  decision  snslysis  techniques,  a  general  sodel  was  developed 
for  base-level  aircraft  inspection  interval  decisions.  This  model 
differs  from  current  methods  such  as  actuarial  analysis  and  the  Computer 
Monitored  Inspection  Program  in  that  it  is  designed  to  define  and  measure 
the  significance  of  the  subjective  uncertainties  and  risks  inherent  in 
inspection  interval  decisions.  Failure  data,  cost  data,  expert  opinion, 
and  decision  maker  preferences  are  brought  together  in  a  single,  unified 
decision-making  framework.  Eecision  alternatives  are  evaluated  based  on 
the  entire  "cost"  picture  (i.e.  repair  costs,  opportunity  costs,  and 
inspection  costs).  The  general  model  developed  in  this  thesis  can  serve 
as  a  starting  point  for  the  analysis,  but  it  must  be  tailored  for  the 
actual  subsystems  to  which  it  is  applied.  Once  the  specific  model  for  a 
given  subsystem  is  built,  it  can  be  analyzed  using  existing  software 
packages.  An  example  of  how  the  tailoring  and  analysis  nay  be 
accomplished  is  provided  in  a  detailed  study  of  the  B-IB  Anti-Skid 
subsystem.  The  decision  analysis  approach  will  be  most  advantageous  when 
used  on  subsystems  which  have  potentially  serious  failure  consequences  or 
economical  concerns. 
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DECISION  ANALYSIS  APPLIED  TO  INSPECTION  INTERVAL  DECISIONS 


I .  Introduction 


Scheduled  inspections  ere  a  significant  part  of  the  United  States 
Air  Force's  (USAf)  preventive  aaintenance  prograa.  An  effective,  well- 
tiaed  inspection  prograa  allows  aircraft  coaponents  to  attain  the 
inherent  reliability  designed  into  then.  Conversely,  an  inspection 
interval  with  poor  tiaing  can  lead  to  too  nany  operational  failures,  high 
aaintenance  costs,  loss  of  aircraft,  and  even  loss  of  hunan  life.  In 
short,  the  effectiveness  of  a  preventive  aaintenance  inspection  prograa 
is  evaluated  in  terns  of  the  failure  consequences  it  prevents  (9:36). 

Understandably,  choosing  the  best  inspection  interval  for  a  given 
coaponent  is  not  an  easy  task.  The  decision  aust  take  into  account  the 
aany  uncertainties  associated  with  aodern  aircraft  hardware  failures. 

What  is  the  likelihood  of  failure?  How  does  one  catch  a  failure  before 
it  actually  happens?  What  are  the  consequences  when  a  given  coaponent 
fails?  These  are  sone  of  the  questions  that  aust  be  answered  in  order  to 
aake  the  best  inspection  interval  decision.  To  coapound  the  problea, 
soae  of  the  failure  data  collected  as  the  systea  aatures  aay  be  aissing 
or  inaccurate. 

The  USAF  recognized  the  iaportance  of  effective  preventive 
aaintenance  aany  years  ago,  but  has  been  slow  developing  an  effective 
decision  process  for  the  inspection  interval  part  of  preventive 
aaintenance.  In  the  early  1970s  the  USAF  followed  the  lead  of  the 
coaaercial  airlines  and  iapleaented  a  new  aaintenance  prograa  called 
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Reliability  Centered  Maintenance  (RCM) .  k  key  part  of  the  prograa  was  to 

adjust  base-level  inspection  intervals  for  various  aircraft  coaponents  as  I 

operational  failure  data  becaae  available.  According  to  AFLC/AFSC 

Regulation  66-35,  Reliability  Centered  Maintenance  Prooraa.  inspection 

intervals  should  be  assessed  every  two  years.  This  interval  adjustaent 

process  is  the  responsibility  of  the  Systea  Prograa  Managers  (SPM)  at  Air 

Force  Logistics  Coaaand  (AFLC)  Air  Logistics  Centers  (ALC)  (4:5,7). 

Unfortunately,  today  there  is  still  no  standard  USAF  procedure  for 
choosing  inspection  intervals.  As  a  result,  individual  ALCs  within  AFLC 
have  devised  their  own  aeans  of  carrying  out  the  inspection  interval 
adjustaent  process.  Few  of  these  prograas  are  docuaented  and  their 
success  is  aabiguous.  Nozer  Singpurwalla  and  Major  Carlos  Talbott 
assessed  the  benefits  of  the  RCM  prograa  as  a  whole  for  one  test  case, 
the  C-141,  and  found  no  clear  iaproveaents  in  logistics  or  operations 
Measures  (11:15). 

Justification 

AFLC  is  currently  searching  for  a  standardized  procedure  for 
deteraining  optiaal  inspection  intervals  which  could  be  organically  (non¬ 
contractor)  supported.  AFLC/MMTQA  recently  proposed  the  problea  to  the 
AFIT  Graduate  Operations  Research  prograa  as  a  student  thesis. 

Research  Objectives 

There  are  two  objectives  for  this  research  project:  1)  propose  a 
general  decision-aaking  Methodology  which  can  be  used  by  AFLC  Systea 
Prograa  Managers  (SPMs)  and  their  staffs  to  help  in  the  selection  of 
intervals  for  base-level  inspections  and,  2)  deaonstrate  how  this 
aethodology  can  be  applied  to  a  specific  aircraft  subsystea,  the  B-IB 
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Anti-Skid  subiyitea.  The  end  product  of  the  research  will  be  a  decision- 
■aking  fraaework,  not  a  production  software  package  or  aatheoatical 
algoritha.  The  intent  of  this  thesis  research  is  concept  exploration  and 
developaent  of  a  decision-aaking  tool  that  AFLC  SPNs  can  use  to  make 
inspection  interval  decisions. 

Organization  of  the  Thesis 

This  paper  is  organized  to  show  a  logical  flow  of  ideas  from 
establishing  the  need  for  an  inspection  interval  aethodology  to 
deaonstrating  its  use.  The  Introduction  and  Literature  Review  chapters 
help  establish  the  need.  The  Model  Development  chapter  explains  how  the 
general  and  specific  decision  models  were  built  and  defines  the  variables 
involved.  The  Model  Analysis  chapter  identifies  the  best  decision  for 
the  B-IB  Anti-Skid  subsystem's  baseline  model  and  presents  sensitivity 
analyses,  value  of  inforaation  calculations,  and  value  of  control 
calculations  for  selected  variables.  The  Recomaendations  chapter 
addresses  the  insights,  applicability,  and  limitations  of  the  decision 
analysis  approach. 
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II.  Lit  eutJirsJ^v  iei* 


Purpose 

The  purpose  of  this  literature  review  is  to  suiaarize  iDformation 
pertaining  to  the  following  decision:  how  often  should  scheduled 
preventive  naintenance  inspections  be  perforned  on  United  States  Air 
Force  (USAF)  aircraft  subsystens?  The  review  addresses  the  following 
subtopics:  1)  the  manner  in  which  the  USAF  currently  determines 
inspection  interval  length,  and  2)  the  attributes  of  decision  analysis 
which  make  it  applicable  to  the  inspection  interval  decision. 

Scope  of  The  Research  Tonic  and  Data  Base  Search 

This  review  is  intended  to  give  the  reader  a  general  understanding 
of  how  the  USAF  currently  determines  base-level  inspection  intervals  and 
how  decision  analysis  could  be  used  to  improve  the  decision  process.  It 
is  not  a  tutorial  on  the  step-by-step  analysis  of  each  approach;  rather, 
it  focuses  on  the  shortcomings  of  the  current  process  and  investigates 
how  decision  analysis  may  be  able  to  cover  them. 

The  on-line  retrieval  systems  and  manual  indices  available  from  the 
AFIT  library  provided  information  on  relevant  literature.  Most  of  the 
literature  on  the  current  USAF  approach  to  inspection  interval  analysis 
came  from  the  DTIC  and  DIALOG  on-line  systems.  The  Operations 
Research/Manaoement  Science  Service  index  provided  sources  of  current 
decision  analysis  literature. 

Method  of  Treatment  and  Organization 

The  following  discussion  of  the  literature  is  arranged  by  topic. 
The  first  section  is  a  summary  of  the  USAF's  current  decision 
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■ethodology.  The  second  deals  with  the  topic  of  decision  analysis.  At 
the  end  are  concluding  reaarks  which  suanarize  the  findings. 

Ci scusslon  of  the  Literature 

Current  Approaches.  The  process  of  deteraining  inspection  interval 
length  is  not  an  established  science  in  the  USAP.  Natheaatical  theory 
occupies  part  of  the  decision-aaking  process,  but  it  falls  short  when 
objectives  are  ill-defined  and  data  is  lacking.  There  are  no  regulations 
or  standards  that  prescribe  the  process  in  its  entirety.  AFLC/AFSC 
Regulation  66-35,  Reliability  Centered  Maintenance  Proaraa.  directs  AFLC 
Systea  Prograa  Managers  (SPMs)  to  periodically  (every  two  years)  assess 
inspection  intervals;  however,  it  does  not  establish  procedures  for 
adjusting  the  intervals  (4:5,7).  It  suggests  two  analytical  tools  that 
the  SPM  offices  can  take  advantage  of  in  the  identification  and 
justification  of  intervals;  actuarial  analysis  and  the  Conputer  Monitored 
Inspection  Program  (CMIP). 

Actuarial  analysis  is  a  broad  tern  that  refers  to  statistical 
analysis  of  failure  data  for  the  purpose  of  characterizing  the 
reliability  of  aircraft  conponents  (9:453).  There  are  nany  different 
statistical  procedures  available  to  inspection  interval  analysis.  Nowlan 
and  Heap  docuaented  a  few  of  the  aost  coaaon  in  their  RCM  textbook 
(9:390-419).  They  all  have  the  sane  liaitations:  1)  they  aust  have 
detailed  age-failure  data  (9:390)  and  2)  they  present  only  reliability 
inforaation  to  the  decision  naker  and  do  not  reconnend  a  decision. 
Actuarial  analysis  is  used  extensively  on  aircraft  engines  to  help 
deteraine  when  engine  parts  should  be  replaced  (1:6).  In  Brill's  thesis 
on  preventive  aaintenance  intervals  for  the  F-lOO  engine,  he  stated  that 
actuarial  data  is  reviewed  annually  by  an  Engine  Life  Planning  Board  to 
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set  BaxiauB  operating  hours  (MOM)  liaits  for  the  engines  (1:6-7).  Then 
he  stated  that  according  to  Air  Force  Manual  400-1,  Selective  ManageBCDt 
of  Propulsion  Units.  Voluae  I.  Policy  and  Guidance,  "MOM  deteraination  is 
based  on  judgaent,  considering  safety,  readiness,  cost,  inventory,  and 
other  logistics  objectives”  (1:7).  This  account  illustrates  a  liaitation 
of  actuarial  analysis.  Actuarial  analysis  does  not  address  the 
subjective  inforaation  and  values  decision  aakers  aust  consider  while 
Baking  decisions. 

In  contrast  to  actuarial  analysis,  CHIP  is  a  specialized,  well- 
docuaented,  contractor-owned  tool  for  setting  inspection  intervals.  It 
is  used  at  the  Varner-Robins  and  San  Antonio  ALCs.  The  proprietor  of 
CMIP,  Dan  Hall  (Lockheed)  stated  that, 

CHIP  was  specifically  designed  to  assist  aaintenance 
aanagers  in  evaluating  the  effectiveness  of  their  scheduled 
aaintenance  prograa  by  identifying  those  inspection 
reguireaents  which  do  not  aaintain  the  aircraft's  inherent 
design  levels  of  safety  and  reliability  with  a  ainiaua 
expenditure  of  logistics  resources.  (3:1,2) 

CMIP  recoaaends  an  optiaua  inspection  interval  for  functional  coaponents 

based  on  the  goal  of  having  no  aalfunctions  between  inspections  (3:3,4). 

It  does  this  by  analyzing  current  aaintenance  data  froa  the  field  and 

comparing  it  to  the  current  inspection  prograa.  If  the  current  prograa 

cannot  provide  at  least  a  70%  confidence  of  no  malfunctions  in  the 

interval  between  inspections,  then  CMIP  recommends  an  alternative 

interval  length  (3:4). 

The  main  liaitation  of  CMIP  is  that  it  only  addresses  part  of  the 
inspection  interval  decision  process.  It  identifies  what  intervals  may 
need  adjusting,  but  its  recomaended  alternative  is  based  on  the  goal  of 
having  no  aalfunctions.  CHIP  does  not  take  into  account  situations  where 
failures  nay  be  tolerated  in  the  interest  of  cost  effectiveness.  As 


6 


noted  in  Nowlan  and  Heap's  RCH  textbook,  if  the  cost  of  repairing  failed 
units  plus  the  costs  of  operational  consequences  is  less  than  the  costs 
of  finding  and  correcting  failures  before  they  occur,  then  failures 
should  not  be  avoided  (9:52).  Like  actuarial  analysis,  CHIP  supplies  the 
decision  aaker  with  statistical  analyses  of  existing  aaintenance  data; 
however,  for  any  other  aspect  of  the  decision,  the  decision  aaker  Bust 
find  other  sources  of  infornation  with  which  to  sake  the  decision. 

Decision  Analysis  Approach.  Decision  analysis  is  a  strategy  for 
Baking  decisions.  It  is  a  nix  of  systeas  analysis  and  statistical 
decision  theory  (6:21)  that  addresses  all  aspects  of  a  decision  problea: 
decision  alternatives,  outcoaes  of  influential  variables,  probabilities 
of  outcoaes,  and  decision  outcoae  values.  Since  the  tera  "Decision 
Analysis"  was  first  coined  in  1966  by  Ronald  A.  Howard,  decision  analysis 
theory  and  practice  have  been  advanced  by  various  aeabers  of  the 
operations  research  coaaunity  (6:vii).  Unfortunately,  the  tera  decision 
analysis  is  now  coaaon  enough  that  it  has  lost  specific  aeaning,  so 
Howard  gives  a  aore  precise  and  descriptive  definition: 

By  decision  analysis  we  aean  a  discipline  coaprising  the 
philosophy,  theory,  aethodology,  and  professional  practice 
necessary  to  foraalize  the  analysis  of  iaportant  decisions. 

Decision  analysis  includes  procedures  and  aethodology  for 
assessing  the  real  nature  of  a  situation  in  which  a  decision 
Bight  be  aade,  for  capturing  the  essence  of  that  situation  in  a 
foraal  but  transparent  Banner,  for  foraally  solving  the 
decision  problea,  and  for  providing  insight  and  aotivation  to 
the  decision  aakers  and  iapleaenters.  (6:viii) 

A  decision  analysis  type  approach  seeas  necessary  for  today's  "real 
world"  probleas.  Any  decision  analysis  aust  have  the  ability  to  deal 
with  the  subjective  nature  of  uncertainties  and  values  of  outcoaes  which 
do  not  easily  lend  theaselves  to  quantification.  In  a  recent  workshop  on 
decision  research  directions  sponsored  by  the  National  Science 


Foundation,  several  experts  in  the  decision  analysis  field  agreed  that 
"in  the  case  of  decision  processes,  what  natters  are  huaan  goals, 
perceptions,  and  eaotions  that  do  not  lend  themselves  to  quantitative 
analysis  in  the  spirit  of  classical  aathenatics"  (2:766). 

The  USAF  problea  of  deternining  inspection  intervals  certainly  fits 
into  this  category  of  "fuzzy"  problems.  Nowlan  and  Heap,  United  Airlines 
employees  who  write  the  RCH  textbooks  for  the  Air  Force,  addressed  the 
problem  of  quantifying  the  real  costs  of  failures  by  stating  "we  have  no 
precise  means  of  assessing  either  the  inherent  level  of  risk  or  the 
increased  risks  that  do  result  from  failures"  (9:337).  The  consequences 
of  component  failures  are  further  complicated  by  the  human  element. 
Nowlan  and  Heap  stated,  "results  of  the  failures  must  be  modified  by  the 
degree  to  which  each  function  affects  safety  and  by  the  ability  of  the 
pilot  to  compensate  for  many  types  of  system  failures”  (9:337).  A 
decision  analysis  approach  could  address  these  types  of  "fuzzy" 
consequences,  risks,  and  probabilities  inherent  in  the  inspection 
interval  decision  process. 

The  strength  of  decision  analysis  lies  in  its  ability  to  deal  with 
probabilities  and  decision  maker  value  preferences.  Decision  analysis 
treatment  of  probability  is  described  by  Howard  below. 

Decision  analysis  treats  probability  as  a  state  of  mind 
rather  than  things  [nature] .  The  operational  justification  for 
this  interpretation  can  be  as  simple  as  noting  the  changing 
odds  on  a  sporting  contest  posted  by  gamblers  as  information 
about  the  event  changes.  As  new  information  arrives,  a  new 
probability  assignment  is  made.  (6:24,163) 

Decision  analysis  does  this  by  supplementing  results  from  statistical 

analysis  with  other  information  available  to  the  decision  maker,  such  as 

expert  judgment.  Peter  Norris  introduced  a  new  framework  for  use  of 


experts  in  decision  nekina  in  his  article  "Decision  Analysis  Expert  Use" 
(8:1233).  In  it  he  stated. 

The  potential  applications  of  a  rich  theory  on  expert  use 
are  aany  and  varied....  In  general  the  theory  to  be  developed 
is  especially  pertinent  to  decisions  affecting  systees  whose 
characteristics  include  significant  uncertainty,  complexity,  or 
both  —  precisely  the  practical  doeain  of  decision  analysis. 

(8:1234) 

The  other  area  of  the  inspection  interval  problea  where  decision 
analysis  aay  be  helpful  is  in  allowing  the  decision  aaker  to  clearly  see 
the  value  (desirability)  of  each  possible  outcoae  of  the  decision. 
Computing  the  value  for  each  possible  outcome  of  each  decision 
alternative  is  a  major  part  of  the  decision  analysis  process. 

For  the  inspection  interval  problem,  the  decision  aaker  must  place 
values  on  outcomes  that  affect  human  safety,  aircraft  availability,  and 
maintenance  costs.  Decision  analysis  explicitly  reveals  to  the  decision¬ 
maker  the  preferences  he/she  is  currently  placing  on  these  factors  and 
allows  re-evaluation  of  them  if  desired.  Theodor  Stewart  described  this 
step  of  the  decision  analysis  process  when  he  wrote,  "the  analyst 
interacts  with  the  decision  maker,  and  allows  him/her  to  reveal 
preferences  gradually  by  means  of  choices  or  value  judgments  expressed 
through  comparison  of  actual  decision  alternatives"  (12:1067). 

An  important  part  of  this  value  modeling  step  is  the  sensitive 
subject  of  human  life  valuation.  Aircraft  are  crewed  by  human  beings  who 
sometimes  lose  their  lives  in  aircraft  crashes  caused  by  component 
failures.  This  is  despite  the  fact  that  precaution  is  taken  to  design 
and  maintain  components  with  acceptably  low  safety  risks.  As  Howard  and 
others  found  in  their  study  on  nuclear  reactor  safety,  setting  an 
acceptably  low  probability  for  an  outcome  involving  death  implies  that 
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the  deciiion  eeker  hai  aede  •  value  of  life  aaseasaent  (6:518).  The  saae 
article  by  Howard  and  others  proposes  a  value  of  life  computation  that 
could  be  used  by  USAF  decision  aakers  in  cases  where  huaan  life  is 
involved  (6:518). 

Conclusions 

Inspection  interval  analysis  is  an  iaportant  yet  neglected  part  of 
the  USAF's  RCM  prograa.  There  is  no  official  procedure  that  precisely 
addresses  the  coaplete  decision  process.  Actuarial  analysis  and  the 
Coaputer  Monitored  Inspection  Prograa  are  established  tools  used  in  the 
current  decision  process,  but  they  are  of  Halted  value.  The  aain 
drawback  of  both  is  that  they  do  not  address  the  subjective  aspects  of 
the  decision-aaking  process  such  as  failure  consequences,  unreliable 
failure  data,  risk  assessaent,  and  value  of  decision  outcomes. 

Conversely,  decision  analysis  is  a  decision-aaking  strategy  that  is 
designed  to  treat  the  very  aspects  of  decision-aaking  the  current 
approach  fails  to  address.  Decision  analysis  coabines  statistical 
analysis,  expert  opinion,  and  decision  aaker  preferences  in  a  single 
decision-aaking  fraaework.  The  result  is  a  coaplete  decision-aaking  aid 
that  recoaaends  an  optiaua  decision  alternative  to  the  decision  aaker. 
Thus,  decision  analysis  can  be  applied  to  the  inspection  interval 
decision  process  to  help  AFLC  SPN  organizations  select  effective 
inspection  intervals. 
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III.  Hod<l  IXvelopient 


lotroductioD 

Decision  tnalysis  as  applied  in  this  research  is  based  on  the 
■ethods  described  in  The  Principles  and  Applications  of  Decision  Analysis 
by  Ronald  A.  Howard  (6)  and  as  taught  in  the  AFIT  Graduate  Operations 
Research  Prograa.  It  is  an  iterative  process  which  is  repeated  until  the 
decision  maker  is  coafortable  enough  with  his/her  understanding  of  the 
problem  to  make  the  decision.  The  initial  part  of  the  analysis  requires 
that  all  variables  thought  to  exert  an  influence  on  the  decision  be 
identified.  The  next  step  is  to  define  the  range  of  outcomes  for  each 
variable,  how  the  variables  mathematically  affect  each  other,  and  what 
value  the  particular  combinations  of  outcomes  have  to  the  decision  maker. 
With  this  information,  the  first  systematic  screening  of  variables  is 
done  by  performing  deterministic  sensitivity  analysis.  Once  this  is 
accomplished,  stochastic  (probabilistic)  information  is  gathered  on  the 
remaining  variables  deemed  significant  to  the  decision.  Then  the 
expected  value  for  each  decision  alternative  is  calculated  and  the 
alternative  with  the  most  attractive  value  (min  in  this  case)  is 
identified.  Finally,  various  postsolution  analyses  are  performed  to 
reveal  how  sensitive  the  baseline  solution  is  to  changes  in  key 
variables. 

For  most  real-world  decisions  like  the  inspection  interval  decision, 
there  are  a  great  number  of  variables  influencing  the  decision.  This 
number  can  be  reduced  initially  with  help  from  the  decision  maker  and 
experts  who  are  familiar  with  the  problem.  Normally,  these  key  people 
can  make  an  early  screening  of  the  variables  based  on  significance  to  the 
decision.  Later,  the  remaining  variables  may  be  screened  further  during 


foraal  sensitivity  analysis  (e.g.  deterministic  sensitivity  analysis). 
The  criteria  for  this  screening  process  is  always  whether  or  not  the 
variable  creates  significant  differences  between  decision  alternatives. 
In  this  manner,  the  decision  analysis  moves  from  the  general  to  the 
specific  as  information  is  screened  and  evaluated  for  significance. 

At  any  given  time  in  the  analysis,  all  variables  included  in  the 
model  and  their  influence  on  each  other  and  the  decision  are  represented 
using  an  influence  diagram  (ID) .  An  ID  provides  a  graphical  framework 
for  both  illustrating  and  solving  a  decision  model  (10). 

The  following  sections  present  the  general  decision  model  first  and 
then  explain  how  it  was  tailored  for  the  B-IB  Anti-Skid  subsystem 
inspection  interval  decision.  The  first  section  gives  a  general 
description  of  each  variable  in  the  general  model.  The  second  section 
explains  in  detail  how  the  general  model  was  simplified  in  building  the 
Anti-Skid  subsystem  decision  model.  The  last  section  in  this  chapter 
presents  the  deterministic  sensitivity  analysis  performed  on  the 
variables  in  the  model  which  remained  after  the  initial  screening. 


The  General  Decision  Model 

The  general  ID  developed  to  serve  as  a  starting  point  for  the 
analysis  of  any  specific  aircraft  component  is  shown  in  Figure  1. 
Depending  on  the  aircraft  component  being  analyzed,  certain  variables  can 
be  simplified  or  deleted  from  this  model  if  the  analysis  shows  they  are 
insignificant  to  the  4ecision  value. 

The  following  paragraphs  give  a  variable  by  variable  description  of 
the  general  model.  Possible  simplifications  and  sources  of  information 
for  some  variables  are  included. 
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Influence  Diagram  for  the  General  Model 


IV$PKT>  INSPECT  is  the  only  decision  variable  in  the  eodel.  The 
values  it  can  taka  on  are  the  alternative  inspection  intervals  froa  which 
the  decision  aaker  aust  choose.  The  goal  of  the  entire  decision  analysis 
is  to  indicate  to  the  decision  aaker  which  alternative  is  the  best.  In 
the  USAF,  proposed  alternative  inspection  intervals  noraally  coincide 
with  existing  aircraft  inspections.  Inspections  of  individual  subsysteas 
are  grouped  or  "packaged"  with  others  so  that  the  aircraft  does  not  have 
to  undergo  thousands  of  ainor  inspections  (9:109).  For  exaaple,  an 
aircraft  aay  currently  have  inspection  packages  of  every  50,  100,  and  200 
flying  hours.  If  this  was  the  case,  an  alternative  different  froa  these 
aay  not  even  be  considered  since  no  current  aaintenance  "package"  could 
incorporate  it.  An  advantage  of  this  liaitation  is  that  the  new  interval 
can  be  readily  iapleaented  by  inspection  personnel  since  it  only  requires 
moving  a  subsystea  froa  one  existing  inspection  package  to  another. 

MTBF.  MTBF  is  a  continuous  random  variable  which  represents 
the  aean  tine  between  failure  for  the  aircraft  subsystea  being  analyzed. 
Most  other  types  of  analyses  dealing  with  reliability  treat  MTBF  as  a 
constant,  ignoring  the  uncertainty  surrounding  its  true  value.  In  this 
nodel,  treating  it  as  a  random  variable  allows  consideration  of  a  range 
of  other  possible  values  for  MTBF.  Actuarial  analysis  of  historical 
failure  data  nay  provide  a  good  estimate  of  the  probability  distribution 
for  MTBF.  Expert  opinion  could  also  be  used  to  supplement  actual  data. 
This  is  especially  advantageous  if  the  decision  aaker  questions  the 
accuracy  of  the  aaintenance  data. 

Ifi.  IQ  stands  for  Inspection  Quality.  This  random  variable 
measures,  in  tine  units  (e.g.  flying  hours),  the  ability  of  inspectors  to 
"capture"  potential  failures  during  inspections  by  detecting  near-failure 


14 


or  fallurt  condltioni.  Thii  variable  is  randoa  in  nature,  but  say  be 
controlled  soaewhat  by  the  inspection  procedures  developed  for  the 
component  in  question.  For  coaponents  with  graceful  degradation,  IQ  can 
be  influenced  according  to  how  far  the  coaponent  is  allowed  to  degrade 
before  it  is  replaced.  In  a  case  where  it  was  allowed  to  degrade  within 
20  hours  of  failure  before  correction,  IQ  would  be  equal  to  20.  However, 
for  coaponents  which  do  not  degrade  gracefully  (e.g.  pure  electronics), 
inspections  are  unable  to  catch  failures  before  they  happen  during 
aircraft  operation  and  IQ  will  be  near  zero.  The  front-end  Reliability 
Centered  Maintenance  Analysis  (RCHA)  (4)  perforaed  by  the  aircraft 
aanufacturer  and  delivered  to  the  Systea  Prograa  Office  is  supposed  to 
address  the  degradation  of  each  aircraft  coaponent.  The  RCHA  is  the 
first  clue  as  to  what  the  IQ  is  for  a  given  coaponent. 

OPFAIL.  OPFAIL  is  a  randoa  variable  representing  the  nuaber  of 
operational  failures  the  subsystea  experiences  during  the  tiae  fraae  the 
decision  covers  (referred  to  in  this  paper  as  "decision  duration") . 

These  are  inherent  or  induced  failures  as  defined  in  aaintenance  aanuals 
and  interpreted  by  the  crew  and  aaintenance  personnel  woricing  with  the 
aircraft.  OPFAIL  is  a  randoa  variable  with  a  wide  range  of  discrete 
outcomes,  but  in  the  analysis  its  range  can  be  truncated  because  after  a 
certain  point,  further  possible  values  will  have  extremely  low  chance  of 
occurrence.  The  variables  IMSPECT,  MTBF,  and  IQ  influence  the 
probability  distribution  for  OPFAIL  outcomes.  If  tiae  between  failures 
is  assumed  to  be  one  of  certain  named  distributions,  such  as  the 
exponential,  the  different  distributions  OPFAIL  takes  on  can  be 
calculated  analytically  given  values  for  INSPECT,  MTBF,  and  IQ.  This 
method  is  demonstrated  in  the  B-IB  Anti-Skid  decision  aodel. 
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POTfAIL.  POTFAIL  stands  for  potential  failures.  It  is  a  randon 
variable  representinp  the  nuaber  of  tines  near-failure  or  failure 
conditions  are  found  during  inspections  and  subsequently  corrected. 

Like  OPFAIL,  the  variables  INSPECT,  MTBF,  and  IQ  influence  the 
probability  distribution  for  POTFAIL,  which  nay  be  derived  analytically 
in  a  siailar  Banner  to  OPFAIL. 

SECDT.  SECDT  stands  for  Secondary  Downtiae.  It  is  a  randoa 
variable  which,  when  given  that  a  failure  in  the  priaary  subsystea  has 
occurred,  represents  the  total  tine  the  aircraft  is  unavailable  to  the 
coaaander  during  correction  of  a  failure  in  soae  other  (secondary) 
subsystea  whose  failure  was  caused  by  the  priaary  subsystea  failure. 

Soae  aircraft  subsysteas  have  little  or  no  potential  for  causing 
secondary  downtiae,  while  others,  safety  related  iteas  for  exaaple,  nay 
have  great  potential.  SECDT  is  a  continuous  variable  whose  probability 
distribution  aust  usually  be  derived  froa  expert  opinion.  The  rare  event 
nature  of  this  variable  leaves  little  or  no  historical  data  froa  which  to 
derive  it.  Inforaation  on  this  variable  can  be  used  to  derive  discrete 
values  for  AVGSECDT. 

SECRC .  SECRC  stands  for  Secondary  Repair  Costs.  It  is  a  continuous 
randoa  variable  which,  given  that  a  failure  in  the  priaary  subsystea  has 
occurred,  represents  the  total  cost  to  the  governaent  for  repairing  other 
(secondary)  aircraft  subsysteas  whose  failure  was  caused  by  the  priaary 
subsystea  failure.  Like  SECDT,  the  potential  here  varies  greatly  froa 
one  subsystea  to  the  next,  but  its  actual  occurrence  nay  be  relatively 
rare  and  historical  data  non-existent.  Inforaation  bn  this  variable  can 
be  used  to  derive  discrete  values  for  AVGSECRC. 
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AVGSECDT.  AVGSECDT  stands  for  Average  Secondary  Downtise.  It  is 
the  average  of  SECDT  over  the  decision  duration  tiae  period.  It  is  a 
continuous  randoa  variable  which  can  be  approxiaated  using  discrete 
values  derived  analytically  froa  the  SECDT  probability  distribution.  An 
exaaple  of  this  derivation  is  described  in  the  section  on  the  Anti-Skid 
subsystea  decision  aodel. 

AVGSECRC .  AVGSECRC  stands  for  Average  Secondary  Repair  Costs.  It 
is  the  average  of  SECRC  over  the  decision  duration  tiae  period.  It  is  a 
continuous  randoa  variable  which  can  be  approxiaated  using  discrete 
values  derived  analytically  froa  the  SECRC  probability  distribution.  An 
exaaple  of  this  derivation  is  described  in  the  section  on  the  Anti-Skid 
subsystea  decision  aodel. 

AVAILVALUE.  AVAILVALinc  represents  the  dollar  value  the  decision- 
aaker  places  on  a  given  tiae  unit  of  aircraft  availability.  This 
variable  should  be  set  to  a  value  which  reflects  the  preferences  of  the 
decision  aaker.  Ideally,  this  value  should  coae  directly  froa  the 
decision  aaker  since  it  is  a  subjective,  indirect  aeasure  of  the  worth  to 
national  defense  he/she  places  on  the  aircraft.  Personnel  at  Oklahoaa 
City  ALC  coaaented  that  one  way  to  approxiaate  this  value  is  to  divide 
aircraft  flyaway  cost  by  the  life  tiae  of  the  aircraft. 

AVGSECOPPCOST.  AVGSECOPPCOST  stands  for  Average  Secondary 
Opportunity  Cost.  It  is  a  deterainistic  variable  aade  up  of  a  function 
which  aultiplies  AVAILVALUE  by  AVGSECDT.  It  is  a  aeasure  of  the 
opportunity  or  availability  costs  to  the  Air  Force  when  secondary  daaage 
occurs. 

AVCOPDT.  AVGOPDT  stands  for  Average  Operational  failure  Downtiae. 
AVGOPDT  represents  the  average  aaount  of  downtiae  the  aircraft 
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exp«ri«ocei  whil*  an  operational  failure  of  the  primary  subsystem  is 
being  corrected.  It  is  a  continuous  random  variable,  but  in  specific 
analyses  it  may  be  set  to  a  constant  if  it  varies  relatively  little  over 
tine.  Host  subsystem  failures  on  aircraft  are  resolved  by  a  remove  and 
replace  procedure.  For  many  components  the  time  it  takes  to  do  this  will 
be  fairly  standard.  In  addition,  if  this  variable  exhibits  similar 
values  to  AVGPOTDT,  both  variables  will  be  insignificant  to  the 
inspection  interval  decision.  This  relationship  is  explained  in  detail 
in  the  section  on  the  Anti-Skid  subsystem  decision  model. 

AVGOPRC .  AVGOPRC  stands  for  Average  Operational  failure  Repair 
Costs.  AVGOPRC  is  the  average  total  cost  to  the  government  the  aircraft 
experiences  when  an  operational  failure  of  the  primary  subsystem  is 
corrected.  It  is  a  continuous  random  variable,  but  in  specific  analyses 
may  be  set  to  a  constant  if  it  varies  relatively  little  over  time.  As 
described  in  the  section  below  on  the  Anti-Skid  subsystem  decision  model, 
if  this  variable  takes  on  similar  values  to  AVGPOTRC,  both  variables  will 
be  insignificant  to  the  decision. 

AVGPOTDT.  AVGPOTDT  stands  for  Average  Potential  failure  Downtime. 

It  is  similar  to  AVGOPDT,  explained  above,  except  that  it  only  applies  to 
primary  subsystem  potential  failures,  not  operational  failures. 

AVGPOTRC.  AVGPOTRC  stands  for  Average  Potential  failure  Repair 
Costs.  It  is  similar  to  AVGOPRC,  explained  above,  except  that  it  only 
applies  to  primary  system  potential  failures,  not  operational  failures. 

PRIMECOHSQ.  PRIMECONSQ  stands  for  Primary  Consequences.  It  is  a 
deterministic  variable  made  up  of  a  function  which  sues  up  all  repair  and 
opportunity  costs  (as  a  result  of  downtime)  associated  with  both 
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op«rationtl  and  potential  failures  of  the  nriiarv  aubsysten.  It  is 
coaputed  by  the  equation 

PRIHECONSQ  >  OPFAIL  (AVGOPRC  *  (AVGOPDT  X  AVAILVALUE) ) 

+  POTFAIL  (AVGPOTRC  ♦  (AVCPOTDT  X  AVAILVALUE))  (1) 

SECCOHSQ.  SECCONSQ  stands  for  Secondary  Consequences.  It  is  a 
deterainistic  eariable  aade  up  of  a  function  which  subs  up  all 
opportunity  costs  (as  a  result  of  downtiae)  and  repair  costs  associated 
with  operational  failure  secondary  consequences.  It  is  coaputed  by  the 
equation 

SECCONSQ  «  OPFAIL  (AVGSECOPPCOST  AVGSECRC)  (2) 

INPERCOST.  INPERCOST  stands  for  Inspection  Personnel  Cost.  It  is  a 
randoB  variable  aade  up  of  a  function  which  aultiplies  the  averaqe  nuaber 
of  aanhours  it  takes  to  perfora  an  inspection  by  a  standard  wage  rate  for 
Air  Force  personnel.  For  aost  subsysteas  this  variable  aay  be  treated 
deterainistically  by  using  a  single  noainal  value.  Ifaintenance  aanuals 
noraally  indicate  the  nuaber  of  persons  required  to  perfora  an  inspection 
for  a  given  subsystea.  Maintenance  personnel  can  provide  expert  opinion 
on  how  long  the  inspection  noraally  takes  to  perfora.  Air  Force 
Regulation  173-13  can  be  used  to  obtain  Air  Force  personnel  wage  rates. 

INDT.  IKDT  represents  the  average  aaount  of  downtiae  the  aircraft 
experiences  while  undergoing  a  single  inspection  of  the  subsystea.  If 
this  tiae  varies  little,  it  aay  be  set  to  a  noainal  value.  Maintenance 
personnel  can  noraally  provide  inforaation  on  this  variable. 

INEMCOST .  INEMCOST  stands  for  Inspection  Equipaent  and  Material 
Costs.  It  represents  the  average  cost  the  Air  Force  incurs  while 
perforaing  a  single  inspection  in  terns  of  expendable  aaterials  and  test 
equipaent.  Maintenance  personnel  can  noraally  provide  inforaation  on 


this  variable. 


DECVALUE.  DECVALUE  stands  for  Decision  Value.  It  is  a 
deterainistic  variable  aade  up  of  a  function  which  aeasures  the  value 
(costs)  to  the  decision  naker  of  each  possible  decision  outcome  (all 
possible  combinations  of  outcomes  of  the  other  variables  in  the  model). 

It  reflects  all  inspection  consequences  and  operational  consequences 
which  differentiate  one  decision  alternative  from  the  another.  Its  value 
is  computed  by  the  equation 

DECVALUE  »  [(Decision  duration/INSPBCT)  (INPERCOST  +  (IMDT  x  AVAILVALUE) 

*  INEMCOST)]  *  PRIMECONSQ  +  SECCONSQ  (3) 

The  decision  alternative  with  the  lowest  expected  value  (cost)  is  the 

optimal  inspection  interval.  A  simplifying  assumption  made  here  is  that 

the  decision  maker  chooses  based  on  expected  value.  This  means,  for 

example,  that  to  the  decision  maker  costs  of  $100,000  are  twice  as  bad  as 

costs  of  $50,000.  If  the  decision  maker  does  not  exhibit  this  type  of 

behavior,  a  unique  utility  function  must  be  derived  which  transforms  the 

dollar  value  of  each  decision  outcome  into  utility  (6:627).  In  this  case 

the  decision  would  be  based  on  lowest  expected  utility  instead  of  lowest 

expected  value. 

The  Anti-Skid  Subsystem  Decision  Model 

The  B-IB  Anti-Skid  subsystem  is  made  up  of  five  subcomponents: 
control  box,  speed  sensor,  manifold,  control  valves,  and  filter  element. 

A  rough  schematic  of  the  system  breakdown/function  description  is  shown 
in  Appendix  A.  Currently,  this  subsystem  is  inspected  only  on  an 
exception  basis:  it  has  no  scheduled  inspections.  It  is  only  inspected 
in  the  case  of  brake  overheating,  hard  landings,  suspected  failure,  etc. 
It  was  chosen  as  the  test  case  for  this  thesis  because  it  is  a  relatively 
simple  subsystem,  degradation  is  detectable,  and  its  operational  failure 
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has  the  potential  (or  causing  serious  damage  to  other  subsystems  on  the 
aircraft. 

I 

The  ID  model  developed  specifically  for  the  Anti-Skid  subsystem  is 
shown  in  Figure  2.  As  a  result  of  initial  screening,  many  of  the  random 
variables  in  the  general  model  were  modified  in  this  model.  The  reasons 

I 

for  these  modifications  are  discussed  below. 

IQ  was  set  equal  to  a  constant  in  the  model  because  it  is  so  heavily 
influenced  by  how  rigorous  the  inspections  are  performed.  Captain  Scott 

I 

Dayton,  ASD/B-IBEF,  provided  approximate  maximum  values  for  the 

individual  components  comprising  the  Anti-Skid  subsystem.  The  average  of 

these  values  was  5  flying  hours,  with  a  low  of  0  and  a  high  of  20.  ^ 

Consequently,  in  the  baseline  model,  IQ  was  set  equal  to  5.  The  extreme 

values  in  the  range  were  investigated  during  sensitivity  analysis  to 

allow  the  decision  maker  to  see  how  inspection  quality  affects  the 

f 

inspection  interval  decision. 

The  variables  AVGOPDT,  AVGOPRC,  AVGPOTDT,  and  AVGPOTRC  were  set 
equal  to  constants  after  discussions  with  Capt  Dayton  confirmed  the  ^ 

author’s  own  opinion  that  the  decision  choice  would  be  insensitive  to 
these  variables.  Nominal  values  for  these  variables  were  4  hours,  $500, 

4  hours,  and  $500  respectively.  These  values  reflect  the  assumption  that  ^ 

average  repair  costs  and  average  downtime  for  the  Anti-Skid  subsystem 

components  will  be  the  same  for  both  operational  failures  and  potential 

failures.  That  is,  it  will  take  about  as  long  and  cost  about  as  much  to  ^ 

correct  a  near-failure  during  an  inspection  as  it  will  to  correct  an 

operational  failure  of  the  B-IB  Anti-Skid  subsystem. 

The  inspection  cost  variables  INPERCOST,  INDT,  and  INEMCOST  were  set  I 

equal  to  constants  because  of  their  relatively  small  magnitudes  compared 
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Figure  2.  Influence  Diagram  for  the  B-IB  Anti-Skid  Subsys 


to  the  deciaion  value  (DECVALUE)  and  because  their  invariance  over  time 
would  not  significantly  affect  the  decision.  Examination  of  maintenance 
manuals  revealed  that  inspections  of  the  Anti-SXid  subsystem  can  be 
performed  relatively  quickly  (within  one  hour)  by  two  Airmen  with  no  need 
for  special  equipment  or  materials.  The  resulting  inspection  costs  were 
small  compared  to  the  overall  decision  value  (DECVALUE)  which  measured  in 
the  hundreds  of  thousands  of  dollars.  IHPERCOST,  INDT  and  INEMCOST  were 
set  to  nominal  values  of  $30,  1  hour,  and  $0  respectively.  IHPERCOST  was 
calculated  using  a  $15  per  manhour  composite  wage  rate  from  APR  173-13, 
Table  3-4,  Change  1,  15  May  1987. 

POTFAIL  was  deleted  from  the  Anti-Skid  subsystem  decision  model 
because  of  its  relatively  small  effect  on  the  decision  value  (DECVALUE) . 
In  the  general  model,  the  impact  of  potential  failures  is  wholly 
contained  in  the  primary  consequences  (PRIMECONSQ)  part  of  the  DECVALUE 
function  Eq  (3).  In  the  PRIMECONSQ  function  Eq  (1),  the  number  of 
potential  failures  (POTFAIL)  is  multiplied  by  the  average  repair  costs 
(AVGPOTRC)  and  average  opportunity  costs  per  potential  failure  (AVGPOTDT 
*  AVAILVALUE) .  As  discussed  above,  these  repair  cost  and  downtime 
factors  were  set  to  the  constants  $500  and  4  hours  respectively. 
AVAILVALUE  was  set  to  a  constant  of  $1182.  Now,  for  the  worst  MTBF  of 
285  flying  hours,  the  expected  number  of  total  failures  (i.e.  all 
failures,  no  matter  when  discovered)  is  2  over  the  two-year  period. 
Therefore,  the  expected  number  of  potential  failures  could  be  no  greater 
than  2  and  the  greatest  contribution  to  PRIMECONSQ  would  be  2(500  +  (4  X 
1182))  *  $10,456.  This  means  that  the  largest  expected  difference 
POTFAIL  could  cause  between  two  alternatives  is  $10,456.  This  is 
insignificant  compared  to  the  impact  operational  failures  (OPFAIL)  had  on 


DECVALUE  and  therefore  POTEAIL  was  not  included  in  the  final  nodel  for 
the  Anti-Skid  subsystem.  In  addition,  since  the  variables  AVGPOTRC,  and 
AVGPOTDT  only  play  a  role  when  POTPAIL  is  non-zero,  these  two  variables 
were  also  deleted  from  the  PRIMECOKSQ  function  and  the  nodel. 

The  following  paragraphs  explain  how  decision  alternatives,  random 
variable  probabilities,  availability  value,  and  primary  consequences  were 
determined  for  the  corresponding  variables  remaining  in  the  nodel. 

INSPECT.  The  decision  duration  in  this  model  was  a  two-year  tine 
period  since  this  is  the  Air  Torce  goal  for  the  tine  between  reassessment 
of  inspectibn  intervals  (4:5).  In  this  model,  three  alternative 
intervals  were  considered  for  the  decision  variable  INSPECT:  5,  100,  or 
600  flying  hours.  The  5  hour  alternative  equates  to  inspecting  every 
sortie.  (Operations  historical  data  obtained  from  the  AFOTEC  Test  Team 
at  Dyess  Air  Force  Base  indicated  that  the  average  sortie  was  4.5  hours 
long.)  The  100  hour  alternative  correlates  to  an  already  existing 
inspection  interval  for  the  aircraft.  The  600  hour  alternative  equates 
to  not  inspecting  the  Anti-Skid  subsystem  at  all  during  the  decision 
duration  (two  years).  According  to  AFR  173-13,  Change  2,  9  March  1988,  a 
B-IB  would  average  about  600  flying  hours  over  a  two-year  time  period. 

MTBF.  The  probability  distribution  for  MTBF  was  constructed  based 
on  failure  data  and  expert  opinion  obtained  from  the  AFOTEC  Follow-On 
Test  and  Evaluation  Team  at  Dyess  AFB,  Texas.  An  inherent  assumption 
here  was  that  B-IB  operations  at  Dyess  were  representative  of  the  B-IB 
fleet  as  a  whole.  Discussions  with  individuals  in  the  B-IB  SPN 
organization  at  Oklahoma  City  ALC  and  the  AFOTEC  Test  Team  revealed  that 
there  was  a  lack  of  confidence  in  the  failure  data  reported  by  AFLC’s 
Maintenance  and  Operational  Data  Access  System  (MODAS) .  The  AFOTEC  team 
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uiet  «n  in-house  systcn.  cilled  OHNIVORE,  to  report  failure  data.  This 
data  base  was  used  instead  of  HODAS  because  the  SPH  organization  had  nore 
confidence  in  it  than  they  did  in  MODAS  data.  The  AFOTEC  reports  on  the 
Anti-Skid  subsysten  indicated  a  HTBF  of  437  flying  hours  (based  on 
counting  inherent  and  induced  failures  over  a  three  year  period).  This 
point  estimate  was  incorporated  into  a  probability  distribution  derived 
by  combining  the  point  estimate  and  expert  opinion.  AFOTEC  Test  Team 
engineer,  Captain  John  Wilder,  was  interviewed  and  he  provided 
information  on  the  likelihood  that  the  true  HTBF  would  take  on  a  range  of 
values  around  the  437  hour  point  estimate.  Probability  wheel  and 
interval  techniques  (6:€14-€24)  were  used  for  this  interview.  Raw  data 
from  this  interview  is  included  in  Appendix  F.  A  manually  fitted 
probability  distribution  curve  for  HTBF  is  shown  in  Figure  3. 
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Figure  3.  MTBF  Probability  Diatribution 
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In  order  for  the  ID  nodel  to  be  solvable,  HTBF  (and  all  other 
continuous  randon  variables)  had  to  be  reduced  to  a  certain  number  of 
discrete  outcome  values.  For  simplification,  the  probability 
distribution  was  sectioned  graphically  (13)  into  three  discrete  values: 
285,  410  and  555.  These  values  represent  the  1/4,  1/2,  and  3/4  fractiles 
for  this  distribution  and  as  such  have  probabilities  of  .25,  .50,  and  .25 
respectively.  Appendix  B  shows  how  the  HTBF  distribution  was  sectioned. 
The  distributions  for  SECDT  and  SECRC  were  sectioned  in  a  similar  manner. 

OPFAIL.  The  probability  distribution  for  OPFAIL  was  analytically 
derived  based  on  the  assumption  that  the  tine  between  failures  for  the 
Anti-Skid  subsystem  is  distributed  exponentially.  This  assumption  was 
made  because  the  exponential  distribution  is  commonly  used  to  model  tine 
between  failure  for  electronic  components  (7:147)  and  OMNIVORE  data 
revealed  that  the  bulk  of  Anti-Skid  failures  are  attributed  to  its 
electronic  components.  Also,  this  assumption  is  made  in  an  existing 
interval  analysis  model,  CHIP  (3:3),  used  at  the  Warner-Robins  and  San 
Antonio  ALC's. 

If  the  time  between  failures  is  distributed  exponentially  with  a 

mean  of  1/X,  then  the  failures  themselves  are  distributed  as  Poisson 

with  mean  \  (5:536).  In  general,  the  Poisson  Probability  function  is 

-  Xt  X 

P(A*Xq)  =  [  e  (Xt)  (4) 

where  *o  “  *  Vi^en  outcome  for  the  random  variable  X 

X  3  the  mean  value  (rate)  of  X  over  tine  t 
t  3  the  total  time  period  of  interest 

Since  failures  are  assumed  to  occur  by  Poisson,  this  equation  can  be  used 

to  calculate'  the  different  probability  distributions  for  OPFAIL  given 

parameters  INSPECT,  MTBF,  and  IQ.  For  our  particular  case,  Xt  is 

computed  by  multiplying  1/MTBF  by  the  sum  of  all  tine  between  inspections 


not  covered  by  IQ, 

Xt  ■  (l/MTBF)  [(decision  duration/INSPECT)  (INSPECT  -  IQ)]  (5) 

IQ  tiae  is  not  included  since  operational  failures  cannot  occur  during 
that  tine  period. 

The  probability  distributions  for  OPFAIL  were  computed  on  a  LOTUS 
spreadsheet  and  are  shown  in  Appendix  C.  The  range  of  possible  outcomes 
for  OPFAIL  is  0  through  5,  5  being  the  maxiBUB  number  because 
probabilities  beyond  5  are  infinitesimal  for  any  of  the  Xt  values. 

SECDT.  The  probability  distribution  for  SECDT  was  constructed  from 
an  interview  with  Capt  Dayton,  ASD/B-IBEF.  Capt  Dayton  is  the  B-IB  SPO's 
expert  on  landing  gear  systems.  The  entire  distribution  was  derived  from 
his  expert  opinion,  since  no  such  historical  data  on  the  B-IB  exists. 
Probability  wheel  and  interval  techniques  (6:614-624)  were  used  to  obtain 
Capt  Dayton’s  best  engineering  judgment  about  the  likelihood  of  secondary 
downtime  given  that  an  operational  failure  in  the  Anti-Skid  subsystem  had 
occurred.  Raw  data  from  this  interview  is  included  in  Appendix  F.  A 
manually  fitted  probability  distribution  curve  is  shown  in  Figure  4. 

In  order  to  obtain  a  set  of  discrete  outcomes  for  this  variable,  the 
distribution  was  graphically  sectioned  (13)  into  three  discrete  values: 

8,  100,  and  325.  Probabilities  for  these  values  are  .25,  .50,  and  .25 
respectively.  The  sectioning  of  the  NTBF  distribution  shown  in  Appendix 
B  serves  as  an  example  of  how  it  was  done  for  SECDT. 

AVGSECDT.  Three  discrete  values  for  AVGSECDT  were  derived 
analytically  from  the  SECDT  probability  distribution  using  a  series  of 
standard  statistical  calculations.  These  calculations  are  presented  in 
detail  in  Appendix  D.  The  three  discrete  values  produced  from  the 
calculations  were  5.954,  133.25,  and  260.546  with  probabilities  of  .25, 
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.50,  and  .25  resptct ively . 
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Figure  4.  SECDT  Probability  Distribution 


SECRC.  The  probability  distribution  for  SECRC  was  constructed  from 
an  interview  with  Mr.  Floyd  Hinnich,  4950th  Test  Wing,  Wright-Patterson 
AFB,  Ohio.  Although  not  specifically  assigned  to  the  B-IB,  Mr.  Minnich 
is  an  expert  on  heavy  aircraft  landing  gear  and  their  failure 
consequences.  He  is  a  retired  Air  Force  member  with  over  20  years 
experience  in  the  heavy  aircraft  maintenance  world.  The  probability 
distribution  was  derived  from  his  expert  opinion.  Probability  wheel  and 
interval  techniques  (6:614-624)  were  used  to  obtain  his  best  judgment 
about  the  likelihood  of  secondary  repair  costs  given  that  an  operational 
failure  in  the  Anti-Skid  subsystem  had  occurred.  Raw  data  from  this 


interview  is  included  in  Appendix  F.  A  nanually  fitted  probability 
distribution  curve  is  shown  in  Figure  5. 
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Figure  5.  SECRC  Probability  Distribution 


The  probability  distribution  for  SECRC  was  graphically  sectioned 
(13)  in  the  same  manner  as  were  MTBF  and  SECDT.  The  sectioning  of  the 
KT6F  distribution  shown  in  Appendix  B  serves  as  an  example  of  how  it  was 
done  for  SECRC.  The  three  discrete  values  for  SECRC  are  500,  2500,  and 
45000  with  probabilities  of  .25,  .50,  and  .25  respectively. 

AVGSECRC.  Three  discrete  values  for  AVGSECRC  were  derived 
analytically  from  the  SECRC  probability  distribution  in  the  same  manner 
AVCSECDT  was  derived  from  SECDT.  (Appendix  D  presents  the  calculations 
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that  ware  perforaed  for  AVGSECDT  which  serve  as  an  exaeple.)  The  three 
values  calculated  for  AVCSECRC  were  $0,  $12625,  and  $32998  with 
probabilities  of  .25,  .50,  and  .25  respectively. 

AVA I LVALUE.  AVAILVALUE  was  set  equal  to  $1182  in  the  baseline 
model.  Ideally,  this  value  should  come  directly  from  the  decision  maker, 
but  in  this  study  the  value  was  approximated  by  dividing  aircraft  flyaway 
costs  ($207  Million)  by  a  20  year  lifetime.  The  flyaway  cost  was  taken 
from  AFR  173-13,  Table  2-6,  Change  2,  9  March  1988.  The  20  year  lifetime 
was  used  since  it  is  commonly  used  for  bomber  aircraft  Operating  and 
Support  coat  estimates  at  ASD.  The  impact  on  the  decision  of  setting 
this  variable  to  different  values  was  explored  during  preference 
sensitivity  analysis. 

PRIMECOMSO.  The  Anti-Skid  subsystem  model’s  equation  for  PRIMECONSQ 
is  the  same  as  for  the  general  model  except  that  the  influence  of  POTFAIL 
was  removed  since,  as  explained  earlier,  that  variable  was  not 
significant  to  the  decision  value.  The  new  equation  for  PRIMECONSQ  is 

PRIMECONSQ  =  OPFAIL  (AVGOPRC  +  (AVGOPDT  X  AVAILVALUE))  16) 


Deterministic  Sensitivity  Analysis 

The  purpose  of  deterministic  sensitivity  analysis  is  to  identify 
which  variables  are  deterministically  significant  to  the  decision.  It  is 
the  first  systematic  screening  of  the  variables  in  the  model.  It  is 
performed  in  the  model  development  phase  of  the  decision  analysis  so  that 
the  analyst's  time  and  energy  can  be  efficiently  focused  on  the  key 
variables  during  the  rest  of  the  analysis.  One  excursion  taken  in  this 
phase  of  the  research  was  to  explore  two  different  ways  of  performing  the 
deterministic  sensitivity  analysis:  the  common  method  and  the  response 
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■urface  Mthod.  Both  aethods  are  introduced  here  briefly  then  discussed 
in  detail  later. 

The  couon  aethod  performs  deterainistic  sensitivity  analysis  on  a 
variable  by  setting  all  other  variables  to  their  nominal  values  and  then 
observing  the  deterministic  change  in  the  decision  value  (DECVALUE)  as 
the  variable  being  studied  is  set  in  turn  to  the  high  and  low  values  in 
its  range.  One  major  weakness  of  this  approach  is  that  it  only  measures 
the  "main  effect"  of  each  variable.  It  does  not  systematically  measure 
the  effect  on  DECVALUE  of  two  or  more  variables  interacting  together 
simultaneously  (an  "interaction  effect").  In  instances  where  a  variable 
had  no  significant  main  effect  of  its  own,  but  had  a  significant 
interaction  effect  with  some  other  variable,  the  common  method  would 
overlook  the  interaction  effect,  screen  out  the  variable,  and  an  error 
may  be  introduced  into  the  decision  analysis  at  that  point.  Another 
weakness  is  that  since  it  only  measures  the  magnitude  of  change  in 
DECVALUE,  it  is  left  up  to  the  ad  hoc  judgment  of  the  analyst  to 
determine  if  the  magnitude  is  significant.  It  does  not  systematically 
"draw  the  line"  between  significance  and  insignificance. 

The  response  surface  method  overcomes  the  weaknesses  of  the  common 
method  by  considering  all  possible  interaction  effects  as  well  as  main 
effects  and  ranking  them  according  to  statistical  significance.  The 
response  surface  method  performs  the  analysis  by  making  experimental  runs 
using  a  factorial  design  matrix  of  the  high  and  low  settings  of  all 
variables.  Each  run  corresponds  to  a  unique  combination  of  the  high  and 
low  settings.  The  value  for  DECVALUE  is  then  recorded  for  each  run. 

Next,  using  all  main  effects  and  possible  interaction  effects  as  the 
independent  variables  and  the  DECVALUE  response  as  the  dependent 
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variable,  a  polynoaial  approxiaatioa  is  derived  using  multiple  regression 
CPROC  REG”  on  SAS,  for  example).  Standard  analysis-of-variance  (ANOVA) 
t-statistics  provide  a  measure  of  the  significance  for  each  term  in  the  ^ 

polynomial,  and  thus  a  measure  of  each  effect's  significance  to  the 
decision  value. 

i 

Common  Method  Analysis.  The  variables  chosen  for  analysis  by  the 
common  method  were  those  variables  remaining  from  the  initial  screening 
of  the  model  which  have  a  deterministic  path  to  DECVALUE  in  the  influence 
diagram:  INSPECT,  OPFAIL,  AVGSECRC,  and  AVGSECDT.  Each  variable  was 
analyzed  separately  by  setting  it  to  its  high  and  low  values  in  turn 
while  the  other  values  were  temporarily  set  to  their  nominal  (middle) 
values.  The  case  of  all  variables  equal  to  their  nominal  values  was  used 
as  a  reference  line  ($533,000).  The  graph  in  Figure  6  shows  the  relative 
deterministic  effect  of  each  variable  on  DECVALUE.  From  this  analysis, 
it  is  clear  that  OPFAIL  and  AVGSECDT  are  significant  to  the  decision 
value.  INSPECT,  the  decision  variable,  loo)cs  only  marginally 
significant.  However,  this  analysis  only  reflects  the  deterministic 
effect  of  INSPECT  on  DECVALUE.  INSPECT  also  has  a  stochastic  effect  on 
DECVALUE  since  it  influences  the  OPFAIL  probability  distribution. 

Therefore,  the  significance  of  INSPECT  cannot  be  judged  solely  on  the 
results  of  this  deterministic  sensitivity  analysis  alone.  On  the  other 
hand,  AVGSECRC  seems  insignificant  compared  to  the  other  variables. 

Based  on  this  method  of  evaluation,  it  could  probably  be  set  to  a 
constant  nominal  value  for  the  rest  of  the  decision  analysis. 

Response  Surface  Method  Analysis.  In  order  to  obtain  a  comparison 
between  methods,  the  same  variables  analyzed  by  the  common  method  were 
analyzed  by  the  response  surface  method.  (A  major  limitation  of  the 
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Figure  6.  Results  of  Common  Method  Determini 


response  surface  sethod  is  that  the  variables  analyzed  nust  be 

independent  of  each  other,  which  is  true  for  the  deterninistic  effects  of 

4 

these  four  variables.)  The  full  2  factorial  design  natrix  used  is  shown 

in  Appendix  E.  For  sinplification,  only  two-way  interaction  effects  were 

considered.  SAS  was  used  to  perfora  the  regression  on  the  data.  PROC 

REG  was  used  first  to  fit  a  regression  aodel  and  then  PROC  STEPWISE  was 

used  as  a  follow-up  to  reveal  the  order  in  which  the  independent 

variables  entered  the  regression  aodel.  The  SAS  Prograa  File  used  to 

accoaplish  this  is  shown  in  Appendix  E. 

The  t-statistics  for  each  effect  are  the  )cey  statistics  of  interest 
2 

here.  The  F  and  R  statistics  for  the  aodel  are  very  high,  as  expected, 

since  the  only  error  in  the  aodel  is  lack  of  fit,  not  randoa  error.  A 

standard  ANOVA  t-test  was  perforaed  by  SAS  on  each  effect,  testing  the 

null  hypothesis  that  the  effect  had  a  coefficient  of  zero  (i.e.  the 

effect  was  insignificant).  In  the  t-test,  a  critical  value  of  t,  with 

some  chosen  confidence  level,  is  taken  froa  a  table  for  the  t 

distribution  and  compared  to  a  calculated  value  of  t  from  the  data.  If 

lt|  <  t  the  null  hypothesis  cannot  be  rejected,  the 

data  critical 

coefficient  of  the  effect  will  be  assumed  to  equal  zero,  and  the  effect 
will  be  considered  insignificant.  However,  if  the  probability  of  It) 

data 

<  t  is  small,  then  the  effect  will  be  assumed  to  have  a  non-zero 
crit 

coefficient  and  the  effect  will  be  considered  significant.  Table  1  lists 


for  each  effect  the  probability  that 
a  confidence  level  of  90%. 


Itl  is  less  than 
data 


t  based  on 
crit 
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Table  1.  Response  Surface  Hethod  t-Statistics  for  Effects 


Effect 

INSPECT 

OPFAIL 

AVGSECRC 

AVGSECDT 

OPFAIL*AVGSECRC 

OPFAIL*AVGSECDT 

INSPECT*OPFAIL 

1NSPECT*AVGSECRC 

1HSPECT*AVGSECDT 

AVGSECRC *AVGSECDT 


Probability  Itl  <_t 

data  crit 

.0001 

.0001 

.0001 

.0001 

.0001 

.0001 

.3079 

.3079 

.3079 

.3079 


Based  on  these  statistics,  all  four  aain  effects  are  significant  as  well 
as  OPFAIL's  interaction  with  AVGSECRC  and  AVGSECDT. 

The  suaaary  of  the  stepwise  regression  procedure  is  shown  in  the 
table  below. 


Table  2.  Response  Surface  Hethod  Stepwise  Regression  Summary 
Step  Effect 

1  OPFAIL 

2  AVGSECDT 

3  OPFAIL*AVGSECDT 

4  INSPECT 

5  AVGSECRC 

6  OPFAIL*AVGSECRC 

(Effects  not  shown  in  the  summary  were  not  significant  enough  at  the  .10 
level  for  entry  into  the  regression  model.)  This  stepwise  regression 


suBBtry  indicates  the  relative  rank  of  the  effects  in  terns  of 
statistical  significance  on  the  decision  value.  Notice  that  an 
interaction  effect,  OPFAIL*AVGSECDT  is  Bore  significant  than  the  main 
effects  for  INSPECT  and  AV6SECRC. 

CoBParina  Results.  For  this  decision  Bodel,  the  two  different 
Bethods  of  perforaing  deterainistic  sensitivity  analysis  yielded  slightly 
different  indications  of  what  variables  were  significant  to  the  decision 
value.  The  coBBon  aethod  showed  the  following  ranking  based  on  magnitude 
of  OECVALUE  change: 

1)  AVGSECOT 

2)  OPFAIL 

3)  INSPECT 

4)  AVGSECRC 

It  also  indicated  that  AVGSECRC  aay  be  relatively  insignificant  because 
of  its  saall  effect  coapared  to  the  other  variables.  Conversely,  the 
response  surface  aethod  yielded  the  following  ranking  based  on  ANOVA 
statistics: 

1)  OPFAIL 

2)  AVGSECDT 

3)  INSPECT 

4)  AVGSECRC 

Using  the  coBBon  method,  the  analyst  Bay  choose  to  siaplify  the  AVGSECRC 
variable  by  setting  it  to  a  constant  noainal  value.  In  contrast,  using 
the  response  surface  method,  the  analyst  would  probably  keep  all  four 
variables  intact  since  they  all  have  statistically  significant  effects  on 
DECVALUE  by  that  method  of  evaluation. 
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The  differences  between  these  two  eethods  would  be  even  aore 
drsBStic  if  s  decision  aodel  was  evaluated  in  which  the  response  surface 
aethod  brought  a  two-way  interaction  effect  into  the  regression  aodel 
before  it  brought  in  one  or  both  of  the  coaponent  aain  effects.  If  this 
was  the  case,  the  coaaon  aethod  would  screen  out  a  coaponent  aain  effect 
because  of  its  stand-alone  insignificance.  In  contrast,  the  response 
surface  aethod  would  indicate  to  the  analyst  that  the  coaponent  variable 
should  be  left  intact  because  of  its  significant  interaction  effect. 

Suaaarv  of  Assuantions 

The  previous  section  explained  how  the  Anti-Skid  subsystea  aodel  was 
developed.  In  the  process,  several  iaportant  assuaptions  were  aade. 

These  assuaptions  are  suaaarized  below: 

1)  The  decision  aaker  chooses  the  best  alternative  based  on  expected 
value. 

2)  The  interval  chosen  will  reaain  in  effect  for  two  years  (i.e.  decision 
duration  equals  2  years) 

3)  Operational  activity  for  aircraft  in  the  B-IB  fleet  evens  out  froa 
aircraft  to  aircraft  over  a  two-year  tiae  period. 

4)  Operational  B-IB  aircraft  activity  at  Dyess  AFB  is  representative  of 
the  other  B-IB  bases. 

5)  Tine  between  failures  of  the  Anti-Skid  subsystea  can  be  aodeled  as  an 
exponential  distribution. 

6)  Repair  costs  and  downtiae  resulting  froa  failures  of  Anti-Skid 
subsystea  coaponents  are  the  saae  for  operational  and  potential  failures. 

7)  Anytiae  an  inspection  is  perforaed,  all  potential  failures  will  be 
correctly  identified  within  the  inspection  quality  (IQ)  liaits. 

8)  Once  identified,  all  potential  failures  will  be  fixed  correctly. 
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c 

9)  Inapectioni  will  not  induce  failurea. 

P  10)  Lost  of  huaan  life  is  not  a  possible  consequence  of  a  B-IB  Anti-Skid 

aubsystea  failure. 


r 
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IV.  Model  An*lv$i8 


Introduction 

This  chepter  presents  the  solution  and  follow  on  sensitivity 
analyses  for  the  B-IB  Anti-Skid  subsysten  decision  aodel,  all  of  which  is 
intended  to  serve  as  an  exaaple  for  analyses  of  other  aircraft 
subsysteas.  The  follow-on  analyses  perforaed  were  stochastic  sensitivity 
analysis,  preference  sensitivity  analysis,  expected  value  of  perfect 
inforaation,  and  expected  value  of  control.  These  analyses  are  an 
iaportant,  integral  part  of  the  overall  decision  analysis  process  because 
they  systeaatically  aeasure  the  iaportance  of  key  variables  in  the 
decision.  Also,  they  can  provide  answers  to  "what  if"  questions  on  the 
initial  solution  which  will  inevitably  occur  in  the  aind  of  the  decision 
aaker . 

Stochastic  sensitivity  analysis  is  different  froa  the  deterainistic 
sensitivity  analysis  perforaed  in  the  aodel  developaent  phase  of  the 
decision  analysis  in  that  instead  of  aerely  aeasuring  the  change  in 
decision  value  (OECVALUE)  when  other  variables  change,  it  aeasures  the 
change  in  the  expected  value  of  the  optiaal  decision  alternative  (called 
the  "certain  equivalent")  as  the  variable  under  study  changes  froa  high 
to  low.  Also,  the  other  randoa  variables  in  the  aodel  are  not 
teaporarily  set  at  noainal  values,  but  are  allowed  to  vary  stochastically 
through  their  ranges.  Preference  sensitivity  analysis  is  similar  to 
stochastic  sensitivity  analysis  except. that  it  exaaines  changes  in  the 
certain  equivalent  caused  by  changes  in  constants  which  the  decision 
aaker  will  set  (i.e.  they  are  subject  to  his  preference). 

The  first  section  in  this  chapter  identifies  the  best  decision 
alternative  for  the  baseline  aodel.  (The  baseline  aodel  is  the  decision 
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■odel  for  th«  Anti-Skid  subsystM  in  which  th«  variables  have  been  set  as 
explained  in  the  Model  Oevelopaent  chapter.)  Once  the  baseline  solution 
is  established,  the  various  analyses  are  presented  in  the  order  in  which 
they  were  perforeed. 

Solution  for  the  Baseline  Model 

The  influence  diaaraa  for  the  B-IB  Anti-Skid  subsysten  was  solved 
using  the  aicroconputer-based  IKDIA  software  package.  Vith  INDIA,  once 
the  influence  diagraa  is  input,  the  "Analyze"  connand  solves  for  the 
decision  alternative  having  the  aininun  expected  value  (cost).  Of  the 
three  alternative  inspection  intervals  (5,  100,  and  600),  5  had  the 
lowest  expected  value,  equal  to  a  certain  equivalent  of  $144,240.  (In 
the  current  B-IB  flying  prograa,  5  flying  hours  roughly  equates  to  one 
sortie.)  A  coaparison  of  the  expected  value  for  each  of  the  three 
decision  alternatives  is  shown  in  Figure  7. 

An  interesting  attribute  of  this  alternative  is  that,  since  in  the 
baseline  aodel  inspection  quality  (IQ)  also  equals  5  flying  hours,  no 
operational  failures  will  be  experienced.  In  other  words,  the  best 
decision  is  to  perfora  inspections  every  S  flying  hours  so  that 
operational  failures  c* a  be  avoided  between  inspections.  The  reason  this 
alternative  has  the  lowest  expected  value  (costs)  is  because  without 
operational  failures  occurring,  there  is  no  risk  of  incurring  any  costly 
secondary  consequences.  The  relationship  here  between  the  inspection 
interval  and  IQ  is  siailar  to  what  exists  for  iteas  placed  on  preflight 
inspection  checklists.  The  consequences  of  failures  for  these  items  are 
serious  enough  that  inspections  are  done  every  flight  with  the  assuaption 
that  operational  failures  will  be  avoided.  The  inspection  quality  is 
assuaed  to  be  at  least  as  long  as  the  average  sortie,  so  that  failures 
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which  would  otherwise  occur  between  inspections  are  detected  during  the 
inspections. 


($000s)  5  100  600 

Inspection  interval 


Figure  7.  Comparison  of  Expected  Value  for 
Decision  Alternatives 


How  does  this  solution  change  with  changes  in  IQ,  HTBF,  etc? 
Answering  this  question  is  the  objective  of  the  following  sections. 

Stochastic  Sensitivity  Analysis 

The  variables  ooroally  included  in  a  stochastic  sensitivity  analysis 
are  the  decision  variable  and  all  randoa  variables  in  the  aodel.  For  the 
B-IB  Anti-Skid  subsystem  influence  diagraa  these  variables  are  the 
decision  alternatives  (INSPECT) ,  HTBF,  number  of  operational  failures 
(OPFAIL) ,  average  secondary  repair  costs  (AVGSECRC) ,  and  average 
secondary  downtime  (AVGSECOT) .  As  an  exception,  this  analysis  also 
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investigated  the  aodel'a  stochastic  sensitivity  to  different  values  of  IQ 
even  though  it  is  treated  as  a  constant  in  the  model. 

The  graph  shown  in  Figure  8  shows  the  relative  stochastic 
sensitivity  of  the  aodel's  certain  equivalent  to  each  variable.  Judging 
by  eagnitude  of  change,  all  variables  except  MTBF  and  AVGSECRC  have 
significant  stochastic  effects  on  the  certain  equivalent.  The  nil 
effects  of  these  two  variables  mean  that  no  aatter  what  outcome  in  their 
ranges  these  two  variables  take  on.  the  certain  equivalent  of  the 
decision  will  not  change  from  the  optimal  value  of  $144,240,  nor  will  the 
optimal  decision  alternative  of  inspecting  every  5  flying  hours  change. 
The  reason  MTBF  has  no  effect  on  the  baseline  solution  is  that  no  matter 
what  MTBF  is,  the  decision  to  inspect  every  5  flying  hours  will  avoid  all 
operational  failures  and  the  costly  secondary  consequences.  The  reason 
AVGSECRC  has  no  effect  is  that  even  at  its  low  value,  the  model  will 
still  want  to  avoid  secondary  consequences  because  AVGSECDT  is  so 
substantial.  If  AVGSECRC  is  at  its  high  value,  secondary  consequences 
are  even  more  costly,  and  the  model  will  certainly  stay  with  the  decision 
to  avoid  all  operational  failures. 

All  the  foregoing  results  apply  to  the  baseline  model  which  has  IQ  = 
5.  Next,  a  separate  analysis  was  performed  on  IQ  to  investigate  how  the 
decision  might  change  with  IQ  set  at  other  values  in  its  range.  The 
results  of  this  analysis  are  shown  in  Figure  8  with  the  original 
sensitivity  analysis  on  the  other  variables. 

The  analysis  on  IQ  reveals  that  the  certain  equivalent  and  decision 
do  change  when  IQ  moves  from  5  hours  to  an  extreme  value  of  1  hour. 
However,  when  IQ  is  set  to  the  other  extreme  of  20  hours,  the  certain 
equivalent  and  decision  are  unchanged.  Consequently,  an  additional 
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stochastic  sensitivity  analysis  was  performed  with  IQ  set  equal  to  1  hour 
to  see  if  MTBF  would  become  a  significant  factor  in  the  decision.  The 
only  random  variable  included  was  MTBF  because  its  nil  effect  in  the 
baseline  model  was  caused  by  the  INSPECT  =5,  IQ  =  5  combination. 

The  graph  in  Figure  9  shows  the  stochastic  sensitivity  analysis 
performed  with  IQ  =  1. 


Figure  9.  Results  of  Stochastic  Sensitivity  Analysis 
with  IQ  «  1 

In  this  second  analysis,  the  certain  equivalent  is  now  $270,020  and 
the  optimal  decision  is  to  inspect  every  600  flying  hours.  Now,  the 
certain  equivalent  is  sensitive  to  a  change  in  MTBF,  but  the  optimal 
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decision  it  not.  Vith  IQ  ■  1,  no  setter  whet  velue  HTBP  tekee  on  in  its 
defined  renge,  the  optisel  decision  will  be  to  inspect  every  600  flying 
hours.  The  reeson  for  this  is  because  with  IQ  «  1,  inspections  ere 
ineffective;  they  heve  little  chance  of  preventing  operational  failures, 
so  inspections  sight  as  well  not  be  perforsed  during  the  two-yeer  tine 
period. 

Since  stochastic  sensitivity  analysis  revealed  that  the  best 
decision  alternative  changes  fros  5  to  600  when  IQ  changes  fros  5  to  1, 
this  range  of  IQ  was  investigated  further.  The  ispact  of  changes  in  IQ 
on  the  expected  value  of  each  alternative  is  shown  in  Figure  10.  This 
analysis  reveals  that  the  optisal  decision  alternative  changes  fros  5  to 
100  hours  when  IQ  drops  below  3  hours  and  then  it  quickly  changes  to  600 
hours. 

Also,  as  a  general  result,  this  analysis  verifies  intuition  by 
showing  that  having  inspection  quality  (IQ)  greater  than  the  inspection 
interval  (INSPECT)  is  overkill.  Notice  how  the  expected  value  for 
INSPECT  s  5  levels  off  past  IQ  »  5.  laproving  IQ  past  5  adds  no  benefit 
to  the  5  hour  inspection  interval,  but  it  does  lower  the  costs  of  the 
other  alternative  intervals.  Clearly,  if  the  curves  of  INSPECT  equal  to 
100  and  600  were  projected  further  for  very  high  values  of  IQ,  they  would 
eventually  drop  below  the  curve  for  INSPECT  >  S  and  becoae  better 
alternatives.  They  also  would  level  off  when  IQ  equaled  100  and  600 
respectively.  . 
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Px«C«rMce  SMSltiYiu:  An«iy#if 

The  purpose  of  preference  sensitivity  analysis  is  to  investigate 
other  values  or  ranges  of  values  which  key  "controllable"  variables  nay 
take  on.  The  only  variable  included  in  this  analysis  was  the  value  of 
one  hour  of  aircraft  availability  (AVAILVALUE) . 

AVAILVALUE  represents  the  deterninistic  value  which  the  decision 
■aker  places  on  an  hour  of  aircraft  availability.  It  is  a  neasure  of  the 
subjective  value  he/she  places  on  the  B-lB's  contribution  to  national 
defense.  The  value  used  in  this  decision  nodel  was  $1182,  an 
approxiaation  derived  froa  acquisition  costs.  The  decision  aaker  aay 
want  to  adjust  this  value.  How  would  the  certain  equivalent  and  decision 
change  froa  the  baseline  solution  if  AVAILVALUE  was  changed?  Figure  11 
shows  how  the  expected  value  of  each  alternative  changes  with  *  and  - 
100%  changes  in  AVAILVALUE.  This  graph  shows  that  with  all  other 
variables  set  as  deterained  for  the  baseline  case,  changes  in  AVAILVALUE 
do  not  change  the  optiaal  decision.  For  any  value  of  AVAILVALUE,  the 
best  decision  is  still  to  inspect  every  5  flying  hours.  (Actually,  this 
conclusion  is  probably  not  valid  for  large  changes  in  AVAILVALUE,  since 
variables  siaplified  or  deleted  in  the  aodel,  such  as  POTFAIL,  aay 
suddenly  becoae  significant  when  AVAILVALUE  is  saall.  A  reappraisal  of 
the  aodel  should  be  undertaken  if  AVAILVALUE  is  set  significantly  lower 
than  $1182.)  The  reason  for  this  insensitivity  is  that  inspecting  every 
5  flying  hours  avoids  all  operational  failures,  thus  avoiding  costly 
secondary  consequences.  A  saall  value  would  have  to  be  placed  on 
availability  before  avoiding  operational  failures  would  no  longer  be  an 
attractive  alternative. 
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EM«ct^4  V«lu«  of  Perfect  IntorMtton  (EVPI) 

EVPI  provides  sa  upper  liait  for  the  value  of  additional  inforiation 
on  a  given  randon  variable  in  the  aodel.  For  example,  suppose  a 
contractor  offered  to  do  an  actuarial  analysis  on  NTBF  (at  95%  confidence 
level)  for  $25,000  in  order  to  help  the  decision  aaker  decide  on  the  best 
inspection  interval.  By  coaputing  the  value  of  Jcnowing  MTBF  perfectly 
(100%  confidence  level),  an  EVPI  analysis  would  indicate  whether  this 
offer  was  reasonable  or  not. 

EVPI  is  obtained  by  first  aeasuring  the  certain  equivalent  of  the 
model  when  the  decision  malcer  is  assumed  to  )cnow  (i.e.  have  perfect 
information  on)  the  value  of  the  random  variable  being  analyzed.  This 
expected  value  with  perfect  information  is  then  compared  to  the  original 
certain  equivalent  of  the  decision.  The  absolute  difference  between  the 
two  is  the  EVPI  for  the  given  variable.  In  the  influence  diagram,  this 
is  performed  by  adding  an  arc  from  the  random  variable  to  the  INSPECT 
node.  This  symbolizes  that  information  about  the  random  variable  is 
known  before  the  inspection  interval  decision  is  made. 

EVPI  calculations  were  performed  on  the  baseline  model  (IQ  =  5)  and 
for  an  additional  situation  where  IQ  «  1.  For  the  baseline  aodel,  the 
variables  analyzed  were  the  random  variables  NTBF,  AVGSECRC,  and 
AVGSECDT.  For  the  IQ  «  i  case,  only  NTBF  was  analyzed. 

The  EVPI  calculations  for  the  baseline  model  are  shown  in  Table  3. 


Table  3.  EVPI, 

Baseline 

Nodel 

Variable 

EVPI  Calculation 

EVPI 

NTBF 

1  $144,240  -  144,240  1 

$0 

AVGSECRC 

1  $144,240  -  144,240  1 

$0 

AVGSECDT 


I  $118,570  -  144,240  I 


$25,670 


Th«  fact  that  EVPI  for  HTBP  and  AVGSECRC  equals  $0  it  not  surprising 
since  the  stochastic  sensitivity  analysis  on  the  baseline  aodel  revealed 


that  the  certain  equivalent  and  optinal  decision  were  not  sensitive  to 
changes  in  these  variables.  These  calculations  confira  the  common  sense 
notion  that  the  decision  maker  would  not  want  to  pay  any  money  for 
information  on  variables  that  had  no  effect  on  his  decision.  Conversely, 
EVPI  for  AVGSECDT  has  value  to  the  decision  maker,  and  such  information 
would  change  the  certain  equivalent  to  a  lower  value  (cost).  However, 
$25,670  is  the  most  the  decision  maker  would  want  to  invest  to  gain  more 
information  about  AVGSECDT. 

The  EVPI  calculation  for  MTBF  in  the  case  of  IQ  3  i  is  shown  below: 

EVPI  for  MTBF  «  I  270,020  -  270,020  I  *  $0  (7) 

The  reason  why  EVPI  for  MTBF  is  $0  in  this  case  is  because  knowing  the 
value  of  MTBF  ahead  of  time  does  not  allow  the  decision  maker  to  avoid 
any  costs  and  the  optimal  decision  would  stay  the  same  (as  shown  in  the 
stochastic  sensitivity  analysis,  Figure  9.)  However,  as  described  next, 
controlling  MTBF  would  have  value. 

Expected  Value  of  Control  (EVC) 

The  EVC  represents  the  value  to  the  decision  maker  of  being  able  to 
control,  by  design,  the  outcome  of  MTBF.  The  calculation  for  EVC  in  the 
case  of  IQ«1  is  shown  below: 

EVC  =  I  192,145  -  270,020  I  »  $77,875  (8) 

This  means  that  $77,875  would  be  saved  if  the  decision  maker  could  set 
MTBF  to  the  best  value  in  its  range  (555).  If  this  was  possible,  the 
best  decision  would  be  to  not  inspect  during  the  two-year  time  period. 


V.  Eftcoii9s4iiisni 


Th«  general  aodel  presented  in  this  thesis  is  a  aeaningful 
representation  of  the  base-level  inspection  interval  decision.  Using 
this  aodel  can  help  the  SPM  and  his  staff  breakdown  this  inherently 
complex  and  subjective  decision  into  the  individual  issues  that  aust  be 
quantified.  Through  the  decision  analysis  process,  a  qualified  analyst 
must  modify  the  general  aodel  into  a  aodel  tailored  for  the  particular 
subsystea  being  studied.  The  specific  aodel  developed  in  this  thesis  for 
the  B-lB  Anti-Skid  subsystea  serves  as  an  example  of  how  this  process 
could  be  carried  out. 

However,  performing  a  decision  analysis  of  this  caliber  is  no  small 
task,  and  the  analyst  doing  it  aust  have  formal  training  in  decision 
analysis  techniques.  This  training  is  necessary  to  develop  expertise  at 
conducting  expert  opinion  interviews,  statistical  analysis,  etc.  More 
often  than  not,  statistical  data  for  the  random  variables  will  be  non¬ 
existent  or  highly  suspect.  Consequently,  considerable  expertise  is 
required  to  obtain  the  necessary  inforaation.  Also,  as  is  true  for  any 
evaluation,  it  is  preferable  that  the  analyst  have  first-hand  exposure  to 
the  aircraft  subsystea  being  evaluated.  This  knowledge  is  especially 
helpful  in  modifying  the  general  decision  aodel  to  represent  the  decision 
for  a  specific  aircraft  subsystea. 

Due  to  the  considerable  investment  of  tiae  and  energy  required  to 
perform  a  thorough  decision  analysis,  not  every  aircraft  subsystems 
should  be  analyzed  in  this  manner.  The  best  candidates  for  a  decision 
analysis  are  those  subsystems  on  the  aircraft  which  are  considered  either 
costly  to  inspect  or  costly  to  not  inspect  (in  terns  of  possible 
operational  consequences.)  The  type  of  decision  analysis  presented  here 


would  provide  t  thorough  treataent  of  theae  "atrategic"  deciaiona,  but  it 
ia  too  pain-ataking  for  aubayateaa  of  leaaer  conaequencea. 

Since  the  general  aodel  ia  intended  to  aerve  aa  a  ahell  to  be 
uniquely  aodified  for  apecific  aubayateaa,  apecific  recoaaendationa  about 
which  variablea  to  aodify  are  not  appropriate.  However,  the  function  of 
one  iaportant  variable,  inspection  quality  (IQ),  could  be  aodified  and 
investigated  in  a  follow-on  decision  analysis  thesis. 

Currently,  IQ  is  treated  aa  a  randoa  variable  in  the  general  aodel, 
but  it  aay  be  possible  to  aodel  it  aa  a  decision  variable.  As  was 
explained  earlier,  this  variable  is  influenced  by  how  rigorous  of  an 
inspection  the  SPM  wants  his/her  aaintenance  personnel  to  perfora. 
Therefore,  it  is  arguable  that  IQ  could  be  aodeled  as  a  decision 
variable,  like  INSPECT,  rather  than  a  randoa  variable.  In  this  case  the 
aodel  would  be  representing  two  decisions:  how  often  to  inspect  and  how 
thorough  to  inspect. 

Another  area  that  nay  prove  fertile  for  further  research  is 
deterainistic  sensitivity  analysis.  Of  the  two  aethods  coapared  in  this 
thesis,  the  response  surface  nethod  seeaed  superior.  It  allowed  for  a 
aore  systenatic  screening  of  variables  for  significance  because  it 
foraally  considered  interaction  (aulti-variable)  effects  as  well  as  main 
(single  variable)  effects  and  judged  significance  on  proven  statistical 
tests.  The  coaparison  between  the  two  aethods  should  be  carried  further 
by  applying  then  to  other  decision  analysis  probleas. 

Even  though  it  is  prinarily  intended  to  serve  as  an  example,  the 
decision  aodel  presented  here  specifically  for  the  B-IB  Anti-Skid 
subsystea  should  prove  very  useful  to  the  B-IB  SPM  and  his  staff.  It 
identifies  the  issues  they  should  consider  when  naking  the  inspection 
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interval  daclaion  for  the  Anti-Skid  subayaten.  Clearly,  the  range  of 
outconea,  probability  diatributiona,  and  value  functiona  for  these 
variablea  ahould  be  conpletely  reviewed  and  verified  by  the  SPH  staff 
before  the  decision  recouended  in  this  thesis  is  adopted.  Stochastic 
sensitivity  analysis  has  shown  that  those  variables  deserving  special 
attention  during  verification  are  nunber  of  operational  failures 
(OPFAIL) ,  secondary  downtine  (SECDT),  average  secondary  downtine 
(AVGSECDT) ,  and  inspection  quality  (IQ) . 

Interestingly,  MTBF  was  not  a  significant  variable  in  the  B-IB  Anti- 
Skid  subsysten  analysis.  The  analysis  showed  that  for  a  HTBF  varying 
stochastically  over  a  range  of  285  to  555  flying  hours,  the  effect  on  the 
decision  was  nininal.  However,  if  the  MTBF  could  be  designed  with  no 
uncertainty  to  a  value  of  555  flying  hours,  the  decision  would  change  and 
inspections  during  the  two-year  tine  period  would  not  be  necessary. 

If  inspection  quality  (IQ)  is  found  to  actually  be  greater  than  5 
for  the  Anti-Skid  subsystem,  another  decision  alternative,  equal  to  the 
actual  IQ  should  be  considered.  In  the  nodel  presented  here,  IQ  was 
equal  to  5  flying  hours  which  allowed  the  5  hour  inspection  interval  to 
result  in  preventing  all  operational  failures.  However,  if  IQ  is  greater 
than  5,  10  for  example,  then  an  inspection  interval  of  10  hours  would 
become  the  best  interval.  It  would  result  in  less  inspection  costs 
because  of  fewer  inspections  and  yet  still  prevent  all  operational 
failures.  It  is  important  to  keep  in  mind  that  the  alternatives 
considered  should  be  ones  which  could  be  practically  implemented  by  base- 
level  maintenance.  No  alternative  should  be  considered  which  the  SPN  or 
base-level  maintenance  personnel  would  not  consider  implementing. 
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Anothar  valut  which  Bust  ba  coordinatad  with  tha  SPM  is  the  value  of 
availability  (AVAILVALUE) .  The  research  presented  here  used  an 
approxiaation  for  AVAILVALUE  that  way  not  be  acceptable  to  the  current 
SPH.  Although  this  analysis  revealed  that  for  the  B-IB  Anti-Skid 
subsystea  AVAILVALUE  did  not  iapact  the  decision,  in  general  it  is  a 
significant  factor  and  with  stochastic  sensitivity  analysis  the  decision 
Baker  can  easily  explore  other  ranges  of  value. 

The  SPH  Bay  also  want  to  relax  soae  of  the  assuaptions  Bade  in  this 
thesis.  In  particular,  the  SPM  Bay  not  be  an  expected  value  decision- 
aaker.  If  this  is  the  case,  a  unique  utility  function  aust  be  derived 
and  applied  to  DECVALUE,  transforaing  DECVALUE  (dollars)  into  utility 
(unitless).  This  would  aore  accurately  aodel  the  decision  aaker's 
attitude  toward  the  true  value  of  the  decision  outcoaes.  Another 
assuaption  which  aay  need  to  be  relaxed  is  the  hoaogeneous  fleet 
assuaption.  In  aany  cases,  the  flying  activity  varies  greatly  froa  base 
to  base  even  for  the  saae  aircraft  type.  In  these  cases,  a  specific 
aodel  would  have  to  be  built  for  each  base  if  the  SPM  wanted  to  treat 
each  base  independently  because  of  the  different  flying  programs. 

Lastly,  although  loss  of  huaan  life  was  not  included  as  a  possible 
consequence  in  either  of  the  aodels  in  this  thesis,  it  is  a  possibility 
for  soae  aircraft  subsystems  and  should  not  be  ignored  in  the  analysis. 
In  these  cases  the  loss  of  huaan  life  should  be  addressed  in  a  value  of 
life  variable  and  an  average  number  of  lives  lost  variable.  Then  these 
two  variables  could  be  multiplied  together  and  added  into  the  secondary 
consequences  function  (SECCONSQ).  As  with  the  value  of  availability, 
through  sensitivity  analysis  the  decision  aaker  could  vary  the  value 
he/she  places  on  life  and  see  the  impact  on  the  optimal  alternative. 
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Inspection  interval  decisions  often  Bust  take  into  account  complex 
operational  failure  consequences  which  can  only  be  neasured  subjectively. 
Current  nethods  of  analysis,  CHIP  for  exanple,  ignore  subjective  aspects 
of  the  decision  such  as  risks  of  failure  consequences,  value  preferences 
of  availability  and  decision  outcoaes,  and  the  reliability  of  failure 
data.  These  types  of  issues  are  the  reals  of  decision  analysis. 

The  decision  analysis  presented  in  this  thesis  identified  the  aost 
important  issues  bearing  on  the  decision  and  modeled  them  in  an  influence 
diagram.  The  diagram  can  be  solved  by  existing  software  packages  which 
identify  the  best  decision  alternative  for  a  given  state  of  information. 
These  programs  also  can  assist  in  performing  the  different  types  of 
postsolution  analyses  which  reveal  to  the  decision  maker  the  key  variables 
and  the  degree  to  which  they  affect  the  decision. 

Two  influence  diagram  models  were  created  for  use  by  AFLC  SPM 
organizations.  First,  a  general  decision  model  was  constructed  that  is 
able  to  accommodate  the  decision  structure  for  most  aircraft  subsystem 
inspections.  In  most  cases,  modification  of  the  general  model's 
structure  will  be  both  necessary  and  prudent  when  applying  it  to  a 
specific  subsystem. 

An  example  of  how  a  decision  analysis  would  be  performed  for  a 
specific  subsystem  decision  was  accomplished  using  the  B-IB  Anti-Skid 
subsystem.  This  relatively  simple  subsystem  was  analyzed  in  order  to 
serve  as  a  learning  tool  for  USAF  analysts  wishing  to  learn  about  and 
adopt  the  decision  analysis  approach  to  inspection  interval  analysis. 

Finally,  many  important  recommendations  were  given,  emphasizing  the 
limitations  and  applicability  of  the  decision  analysis  approach.  It  is 


that  decision  snslysis  it  not  sinple  enough  to  be  used  on 
every  eircreft  subsysten  requiring  periodic  inspection.  However,  it  it  e 
thorough  way  to  decide  how  often  to  inspect  subsystens  where  the  risks, 
costs,  and  other  consequences  of  operational  failures  are  high  and 
difficult  to  quantify. 


Appendix  B:  Graphical  Sectioning  of  the  MTBF 
Probability  Distribution 


:ur-: 


PPOB 


FLYING  HOURS 


Explanation  The  vertical  lines  were  drawn  at  the 
points  corresponding  to  555.  410,  and  285  Decause 
at  these  points  the  areas  of  like  shading  are  equal  to 
each  other.  These  values  can  be  used  as  approximations 
for  the  75th,  50th,  and  25th  fractiles 
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Appendix  C:  OPFAIL  Probability  Distributions 
(Baseline  Model) 
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Appendix  D:  Derivetiop  of  Discrete  Values  for  AVCSECDT  tron  SECDT 


1.  Assune  AVCSECDT  probabilities  are  distributed  as  a  Normal  probability 
distribution. 

2.  E(SECDT)  -  325(.25>  ♦  100(.50)  *■  8(.25)  -  133.25 

2  2 

3.  VAR (SECDT)  -  E(  SECDT  )  -  [E (SECDT)] 

2 

-  31422.25  -  (133.25) 

«  13666.69 

4.  Use  E(OPFAIL)  for  n: 

With  MTBF  «  410,  INSPECT  »  100,  and  IQ  »  5,  E(OPFAIL)  «  1.37 
n 

5.  E (AVCSECDT)  »  1/n  E (SECDT) 

i»l 

»  n(l/n)  (133.25) 

*  133.25 

n  2 

6.  VAR (AVCSECDT)  -  ^  <1/“)  VAR (SECDT) 

i=l 

2  n 

«  (1/n)  2  VAR (SECDT) 

i«l 

2 

»  (1/n)  (n)  VAR(SECDT) 

»  VAR(SECDT)/n  -  13666.69/1.37  *  9975.69 

1/2 

7.  Std  Dev (AVCSECDT)  *  f VAR (AVCSECDT) ]  »  99.84 

8.  For  a  Standard  Normal  probability  distribution: 

Z  =  (X  -  mean) /std  dev 

For  the  75th  fractile  (x),  Z  =  1.275  so, 

1.275  =  (x  -  mean)/std  dev 
X  =  mean  +  1.275 (std  dev) 

*  133.25  1.275(99.84) 

=  260.546 

For  the  25th  fractile  (y) ,  Z  *  -1.275  so. 


-1.275  =  (y  -  mean) /std  dev 
y  *  mean  -  1.275 (std  dev) 

=  133.25  -  1.275(99.84) 

=  5. 954 
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Appendix  E; 
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SAS  Input  Matrix  and  Program  File 
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ULtKiNE  R$H  'Si'J.OAt'! 

ORTA  A$»i; 
iNflLt  RSm; 

INPUT  INT  OPP  ASRC  ASOT  CVALt 
10  •  INT  a  OPPi 
lARC  •  INT  «  ASRCi 

lAOT  <  INT  a  a$ct: 

OARC  >  OPP  «  ASRCi 

OACT  •  OPP  *  ASCT; 

AKCOT  <  ASRC  «  A50T; 

PRCC  PRINT  OATAxCSM! 

VAR  INT  CPP  ASRC  ASOT  lO  lARC  lACT  OARC  CAOT  ARCCT  OVAL! 

PRCC  REG  OATAsRSPi 
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IWr  =  INSPLCT  ASIC  -  AV3SEJC3C 

arr  »  optail  asdt  «  auhsexit 
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